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A  randomized  gossip  consensus  algorithm  on 

convex  metric  spaces 

Ion  Matei,  Christoforos  Somarakis,  John  S.  Baras 


Abstract 

A  consensus  problem  consists  of  a  group  of  dynamic  agents  who  seek  to  agree  upon  certain  quantities  of 
interest.  This  problem  can  be  generalized  in  the  context  of  convex  metric  spaces  that  extend  the  standard  notion 
of  convexity.  In  this  paper  we  introduce  and  analyze  a  randomized  gossip  algorithm  for  solving  the  generalized 
consensus  problem  on  convex  metric  spaces.  We  study  the  convergence  properties  of  the  algorithm  using  stochastic 
differential  equations  theory.  We  show  that  the  dynamics  of  the  distances  between  the  states  of  the  agents  can  be 
upper  bounded  by  the  dynamics  of  a  stochastic  differential  equation  driven  by  Poisson  counters.  In  addition,  we 
introduce  instances  of  the  generalized  consensus  algorithm  for  several  examples  of  convex  metric  spaces  together 
with  numerical  simulations. 


I.  Introduction 

Distributed  algorithms  are  found  in  applications  related  to  sensor,  peer-to-peer  and  ad-hoc  networks. 
A  particular  distributed  algorithm  is  the  consensus  (or  agreement)  algorithm,  where  a  group  of  dynamic 
agents  seek  to  agree  upon  certain  quantities  of  interest  by  exchanging  information  among  them,  according 
to  a  set  of  rules.  This  problem  can  model  many  phenomena  involving  information  exchange  between  agents 
such  as  cooperative  control  of  vehicles,  formation  control,  flocking,  synchronization,  parallel  computing, 
etc.  Distributed  computation  over  networks  has  a  long  history  in  control  theory  starting  with  the  work  of 
Borkar  and  Varaiya  [1],  Tsitsikils,  Bertsekas  and  Athans  [25],  [26]  on  asynchronous  agreement  problems 
and  parallel  computing.  A  theoretical  framework  for  solving  consensus  problems  was  introduced  by  Olfati- 
Saber  and  Murray  in  [16],  [17],  while  Jadbabaie  et  al.  [7]  studied  alignment  problems  for  reaching  an 
agreement.  Relevant  extensions  of  the  consensus  problem  were  done  by  Ren  and  Beard  [19],  by  Moreau 
[13]  or,  more  recently,  by  Nedic  and  Ozdaglar  [14],  [15]. 

Network  topologies  change  with  time  (as  new  nodes  join  and  old  nodes  leave  the  network)  or  exhibit 
random  behavior  due  to  link  failures,  packet  drops,  node  failure,  etc.  This  motivated  the  investigation 
of  consensus  algorithms  under  a  stochastic  framework  [6],  [10],  [11],  [18],  [20],  [21].  In  addition  to 
network  variability,  nodes  in  sensor  networks  operate  under  limited  computational,  communication,  and 
energy  resources.  These  constraints  have  motivated  the  design  of  gossip  algorithms,  in  which  a  node 
communicates  with  a  randomly  chosen  neighbor.  Studies  of  randomized  gossip  consensus  algorithms  can 
be  found  in  [2],  [22]. 

In  this  paper  we  introduce  and  analyze  a  generalized  randomized  gossip  algorithm  for  achieving 
consensus.  The  algorithm  acts  on  convex  metric  spaces ,  that  are  metric  spaces  endowed  with  a  convex 
structure.  We  show  that  under  the  given  algorithm,  the  agents’  states  converge  to  consensus  with  probability 
one  and  in  the  rth  mean  sense.  The  convergence  study  is  based  on  analyzing  the  dynamics  of  a  set  of 
stochastic  differential  equations  driven  by  poisson  counters.  Additionally,  for  a  particular  network  topology 
we  investigate  in  more  depth  the  rate  of  convergence  of  the  first  and  second  moment  of  the  distances 
between  the  agents’  states.  We  present  instances  of  the  generalized  gossip  algorithm  for  three  convex 

Ion  Matei  is  with  the  Institute  for  Research  in  Electronics  and  Applied  Physics  at  University  of  Maryland,  College  Park  (email: 
imatei@umd.edu);  Christoforos  Somarakis  and  John  S.  Baras  are  with  the  Institute  for  Systems  Research  at  University  of  Maryland,  College 
Park  (emails:  csomarak@umd.edu,  baras@umd.edu). 

This  material  is  based  in  part  upon  work  supported  by  the  NIST-ARRA  Measurement  Science  and  Engineering  Fellowship  Program 
award  70NANB 10H026,  through  the  University  of  Maryland,  and  in  part  upon  work  supported  by  the  Army  Research  Office  award  number 
W91  INF-08-1-0238  to  Ohio  State  University. 
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metric  spaces  defined  on  the  set  of  real  numbers,  the  set  of  compact  interval  and  the  set  of  discrete 
random  variables.  The  results  of  this  paper,  complements  our  previous  results  regarding  the  consensus 
problem  on  convex  metric  space,  where  only  deterministic  communication  topologies  are  studied  [8],  [9]. 

The  paper  is  organized  as  follows.  Section  II  introduces  the  main  concepts  related  to  convex  metric 
spaces.  Section  III  formulates  the  problem  and  states  our  main  results.  Sections  IV  and  V  give  the  proof 
of  our  main  results,  together  with  pertinent  preliminary  results.  In  Section  VI  we  present  an  in-depth 
analysis  of  the  rate  of  convergence  to  consensus  (in  the  first  and  second  moments),  for  a  particular 
network  topology.  Section  VII  shows  instances  of  the  generalized  consensus  algorithm  for  three  convex 
metric  spaces,  defined  on  the  sets  of  real  numbers,  compact  intervals  and  discrete  random  variables, 
respectively. 

Some  basic  notations:  Given  W  e  R,wxn  by  [  W ] , j  we  refer  to  the  (/,/)  element  of  the  matrix.  The 
underlying  graph  of  IT  is  a  graph  of  order  n  without  self  loops,  for  which  every  edge  corresponds  to  a 
non-zero,  off-diagonal  entry  of  IT.  We  denote  by  X{A }  the  indicator  function  of  the  event  A.  Given  two 
symmetric  matrices  M\  and  M2,  by  M\  >  M2  (M\  >  M2)  we  understand  that  M\  -  M2  is  a  positive  definite 
(semi-positive  definite)  matrix.  Additionally,  by  M\  <  M2  ( M\  <  M2)  we  understand  that  M2  -  M\  is  a 
positive  definite  (semi-positive  definite)  matrix. 

II.  Convex  Metric  Spaces 

In  this  section  we  introduce  a  set  of  definitions  and  basic  results  about  convex  metric  spaces.  Additional 
information  about  the  following  definitions  and  results  can  be  found  in  [23], [24]. 

Definition  2.1  ([24],  pp.  142):  Let  ( X,d )  be  a  metric  space.  A  mapping  \j/ :  Ax X x  [0, 1]  — »  X  is  said 
to  be  a  convex  structure  on  X  if 

d(u,\\f(x,y,A))  <  Ad(u,x)  +  (1  -  A)d(u,y),  Vx,y,u  e  X  and  VA  e  [0, 1]. 

Definition  2.2  ([24],  pp.142):  The  metric  space  (X.d)  together  with  the  convex  structure  \[/  is  called  a 
convex  metric  space,  and  is  denoted  henceforth  by  the  triplet  (X,  d,\\t). 

Example  2.1:  The  most  common  convex  metric  space  is  defined  on  R",  together  with  the  Euclidean 
distance  and  convex  structure  given  by  the  standard  convex  combination  operation.  Indeed,  for  any  x,y,z& 
R'!  and  A  e  [0,1],  it  follows  that  ||z-(Tx  +  (l  -T)y)||  =  ||d(z-x)  +  (l  -T)(z-y)||  <  T||z-x||  +  (l  -d)||z-y||, 
where  the  last  inequality  followed  from  the  convexity  of  the  norm  operator. 

Example  2.2  ([24]):  Let  X  be  the  family  of  closed  intervals,  that  is  X  =  {[ a,b ]  \  a  <b,  a,b  e  R}.  For 
/,-  =  [ai,bj],  Ij  =  [aj,bj]  and  A  e  [0, 1],  we  define  a  mapping  \|/  by  \\i(Ii,Ij,A)  =  [Ta,  +  (  1  -A)aj,Abj  +  (  1  -A)bj\ 
and  define  a  metric  d  in  X  by  the  Hausdorff  distance,  that  is 

d (7/ ,7 j)  =  max{ \ai  -  aj\ ,  \bi  -  bj\} . 

Then  (X,  d,\\i)  is  a  convex  metric  space. 

More  examples  can  be  found  in  [23]  and  [24].  In  Section  VII  we  introduce  another  interesting  example 
of  a  convex  metric  space,  defined  on  the  set  of  discrete  random  variables  taking  values  in  a  finite,  countable 
set  of  real  numbers. 

Definition  2.3  ([24],  pp.  144):  A  convex  metric  space  (X,d,\\r)  is  said  to  have  Property  (C)  if  every 
bounded  decreasing  net  of  nonempty  closed  convex  subsets  of  X  has  a  nonempty  intersection. 
Fortunately,  convex  matric  spaces  satisfying  Property  (C)  are  not  that  rare.  Indeed,  by  Smulian’s  Theorem 
([3],  page  443),  every  weakly  compact  convex  subset  of  a  Banach  space  has  Property  (C). 

The  following  definition  introduces  the  notion  of  convex  set  in  convex  metric  spaces. 

Definition  2.4  ([24],  pp.  143):  Let  (X,d,  v|/)  be  a  convex  metric  space.  A  nonempty  subset  K  c  A  is 
said  to  be  convex  if  \\r(x,y,A)  e  K,  4x,y  e  K  and  VA  €  [0, 1]. 

Let  P(X)  be  the  set  of  all  subsets  of  X.  We  define  the  set  valued  mapping  \[r :  P(X)  — >  rP(X)  as 


¥(A)  =  Mx,y,T)  |  Vx,y  e  A,VA  e  [0,1]}, 
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where  A  is  an  arbitrary  subset  of  X. 

In  Proposition  1,  pp.  143  of  [24]  it  is  shown  that  in  a  convex  metric  space,  an  arbitrary  intersection  of 
convex  sets  is  also  convex  and  therefore  the  next  definition  makes  sense. 

Definition  2.5  ([23],  pp.  11):  Let  (X,d,\\t)  be  a  convex  metric  space.  The  convex  hull  of  the  set  A  c  X 
is  the  intersection  of  all  convex  sets  in  X  containing  A  and  is  denoted  by  co(A). 

Another  characterization  of  the  convex  hull  of  a  set  in  X  is  given  in  what  follows.  By  defining  Am  = 
\jf(A,„_i)  with  Aq  =  A  for  some  A  c  X,  it  is  discussed  in  [23]  that  the  set  sequence  {Am}m> o  is  increasing 
and  limsupm_>00Aw  exists,  and  lirnsupm^00A,n  =  lim  inf Aw  =  limw^oo  Am  =  LC=o^- 

Proposition  2.1  ([23],  pp.  12):  Let  (X,d,\\t)  be  a  convex  metric  space.  The  convex  hull  of  a  set  A  c  X 
is  given  by 

(X) 

co(A)  =  lim  Am  =  I  I  Am. 

m — »oo  ' — x 

m— 0 

It  follows  immediately  from  above  that  if  Am+\  =Am  for  some  m,  then  co(A)  =Am. 

III.  Problem  formulation  and  main  results 

Let  (X,d,\\f)  be  a  convex  metric  space.  We  consider  a  set  of  n  agents  indexed  by  i,  with  states  denoted 
by  xft)  taking  values  on  X,  where  t  represents  the  continuous  time. 

A.  Communication  model 

The  communication  among  agents  is  subject  to  a  communication  network  modeled  by  a  directed  graph 
G  =  (V, E),  where  V  =  [1,2, ...,n}  is  the  set  of  agents,  and  E  =  { (/, i)  \  j  can  send  information  to  i]  is  the 
set  of  edges.  In  addition,  we  denote  by  Nj  the  inward  neighborhood  of  agent  i,  i.e., 

Nt  =  {j  |  (./,/)  e  E\, 

where  by  assumption  node  i  does  not  belong  to  the  set  A/).  We  make  the  following  connectivity  assumption. 
Assumption  3.1:  The  graph  G  =  (V.E)  is  strongly  connected. 

B.  Randomized  gossip  algorithm 

In  the  following  we  describe  the  mechanism  used  by  the  agents  to  update  their  states.  Agents  can  be 
in  two  modes:  sleep  mode  and  update  mode.  Let  Nft)  be  a  Poisson  counter  associated  to  agent  i.  In  the 
sleep  mode,  the  agents  maintain  their  states  unchanged.  An  agent  i  exits  the  sleep  mode  and  enters  the 
update  mode,  when  the  associated  counter  Nft)  increments  its  value.  Let  lt  be  a  time-instant  at  which  the 
Poisson  counter  Nf  t)  increments  its  value.  Then  at  //,  agent  i  picks  agent  j  with  probability  pL  j,  where 
j  e  N,  and  updates  its  state  according  to  the  rule 

Xi(tf)  =  \| f(xi(ti),Xj(ti),Ai),  (1) 

where  A,-  e  [0,  1),  y  is  the  convex  structure  and  X  /eN,  Pi,j  =  L  By  xfC)  we  understand  the  value  of  xft) 
immediately  after  the  instant  update  at  time  tt,  which  can  be  also  written  as 

xfC)  =  lim  xft), 

1  t>tj 

which  implies  that  xft)  is  a  left-continuous  function  of  t.  After  agent  i  updates  its  state  according  to  the 
above  rule,  it  immediately  returns  to  the  sleep  mode,  until  the  next  increase  in  value  of  the  counter  Nft). 
Assumption  3.2:  The  Poisson  counters  Nf  t)  are  independent  and  with  rate  pt,  for  all  i. 

A  similar  form  of  the  above  algorithm  (the  Poisson  counters  are  assumed  to  have  the  same  rates)  was 
extensively  studied  in  [2],  in  the  case  where  X  =  R. 
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We  first  note  that  since  the  agents  update  their  state  at  random  times,  the  distances  between  agents  are 
random  processes.  Let  d(xj(t),Xj(t ))  be  the  distance  between  the  states  of  agents  i  and  j,  at  time  t.  We 
introduce  the  following  convergence  definitions. 

Definition  3.1:  We  say  that  the  agents  converge  to  consensus  with  probability  one  if 

Pr\  lim  max  d(xi(t),x  At))  =  0  =  1. 

V-»°°  Ui  ) 

Definition  3.2:  We  say  that  the  agents  converge  to  consensus  in  rth  mean  sense  if 

lim  E[d(xi(t),Xj(t))r]  =0,V  (/,./),  i  +  j. 

The  following  theorems  state  our  main  convergence  results. 

Theorem  3.1:  Under  Assumptions  3.1  and  3.2  and  under  the  randomized  gossip  algorithm,  the  agents 
converge  to  consensus  in  rth  mean,  in  the  sense  of  Definition  3.2. 

Theorem  3.2:  Under  Assumptions  3.1  and  3.2  and  under  the  randomized  gossip  algorithm,  the  agents 
converge  to  consensus  with  probability  one,  in  the  sense  of  Definition  3.1. 

The  above  results  show  that  the  distances  between  the  agents’  states  converge  to  zero.  The  following 
Corollary  shows  that  in  fact,  for  convex  metric  spaces  satisfying  Property  (C),  the  states  of  the  agents 
converge  to  some  point  in  the  convex  metric  space. 

Corollary  3.1:  Under  Assumptions  3.1  and  3.2  and  under  the  randomized  gossip  algorithm  operating 
on  convex  metric  spaces  satisfying  Property  (C),  for  any  sample  path  to  of  state  processes,  there  exits 
x*  e  X  (that  depends  on  to  and  the  initial  conditions  jq(0))  such  that 

lim  d(xj(t,co),x*(co))  =  0. 

t — >oo 

In  other  words,  the  states  of  the  agents  converge  to  some  point  of  the  convex  metric  space  with  probability 
one. 


IV.  Preliminary  results 

In  this  section  we  construct  the  stochastic  dynamics  of  the  vector  of  distances  between  agents.  Let  ti 
be  a  time-instant  at  which  counter  Nj(t)  increments  its  value.  Then  according  to  the  gossip  algorithm,  at 
time  t-  the  distance  between  agents  i  and  j  is  given  by 

d(xi(t+),xfit+))  =  d(\\f(xi(ti),xi(tj),Ai),Xj(ti)),  with  probability  pu.  (2) 


Let  Qi(t )  be  an  independent  and  identically  distributed  (i.i.d.)  random  process,  such  that  Pr(6j(t)  =  /)  =  pui 
for  all  l  e  Nl  and  for  all  t.  It  follows  that  (2)  can  be  equivalently  written  as 


d(xj(t'l),x  fitf))  =  ^x{eyti)=i\d(Mxi(ti),xi{ti),  Ai),x fit))). 


(3) 


leN, 


where  X{ ■}  denotes  the  indicator  function.  Using  the  inequality  property  of  the  convex  structure  introduced 
in  Definition  2.1,  we  further  get 

d(xi(tl)pxj(tl))  <  Ajd(xi(tj),Xj(tj))  +  (1  -  Ai)  'YjX{oi{ti)=i}d(xi(ti),Xj(ti)).  (4) 

leNi 


Assuming  that  tj  is  a  time-instant  at  which  the  Poisson  counter  N j(t)  increments  its  value,  in  a  similar 
manner  as  above  we  get  that 

d(xi(fj),xj(fj))  <  Ajd(xj{tj),Xj(tj))  +  (  1  -Aj)  ^X{ej(fj)=i}d(,xi(tj),xi{tj)). 

leNj 


(5) 
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Consider  now  the  scalars  Pijit)  which  follow  the  same  dynamics  as  the  distance  between  agents  i  and 
j,  but  with  equality,  that  is, 


mj 


itf)  =  Ajtjijiti)  +  (1  -  Aj) 


leNi 


and 


Wjtf)  =  AjTntJitj)  +  (  1  -A/)  ej<jj)=im(tj). 


(6) 


(7) 


leN  j 


with  rjij(O)  =  d(xi(0),Xj(0)). 

Remark  4.1:  Note  that  the  index  pair  of  p  refers  to  the  distance  between  two  agents  i  and  j.  As  a 
consequence  ijjj  and  pjA  will  be  considered  the  same  objects,  and  counted  only  once. 

Proposition  4.1:  The  following  inequalities  are  satisfied  with  probability  one: 


Pijit)  ^  0, 
ip, jit)  <  max  r/ij(0), 

d(xi(t),xj(t ))  <  Pi, jit). 


(8) 

(9) 

(10) 


for  all  i  4  j  and  /  >  0. 

Proof:  Inequalities  (8)  and  (9)  follow  immediately,  noting  that  for  any  sample  path  of  the  Poisson 
counters,  Pijit)  are  updated  by  performing  convex  combinations  of  non-negative  quantities.  To  show 
inequality  (10)  we  can  use  an  inductive  argument.  Let  tj  be  the  time  instant  at  which  the  counter  Nft) 
increments  its  value  and  assume  that  d(xi(ti),Xj(ti))  <  Pi.jiti)  for  all  i,  j.  Immediately  after  t\,  the  new  value 
of  d(xj(t),Xj(t))  is  given  by 

dixiit^),Xjit^))  <  AId(xl(tl),xJ(ti))  +  (\  -Aj)  ^*{6 ijiti)=i}d(xi(ti),Xi(ti))  < 

teUj 

<  J-iPij(ti)  +  (i  -Aj)  'YjXmd^pjM)  =  Pi, M)- 

leNj 

Therefore  after  each  increment  of  counter  Nj(t),  we  get  that 

d(xi(tt),Xj(tt))  <  Pi, jit*). 

Using  the  same  argument  for  all  Poison  counters,  inequality  (10)  follows.  ■ 

We  now  construct  the  stochastic  differential  equation  satisfied  by  Pijit).  From  equations  (6)  and  (7) 
we  note  that  Pijit)  at  time  tj  and  tj  satisfies  the  solution  of  a  stochastic  differential  equation  driven  by 
Poisson  counters.  Namely,  we  have 


dp  i,  jit)  = 


-(i  -  Ai)pijit)  +  (l  -  Aj)  ^xmt)=nPj,/i0 

/eJVi 


dN,m 


(1  Aj)rjj,j(t)  +  ( 1  Aj)  ^  ]  X{6 j(t)=m)Pi,mil) 


meNj 


dNAt). 


(11) 


Let  us  now  define  the  n  dimensional  vector  p  =  ipi,j),  where  n  =  —  (since  if  j)  and  (  /,  i)  correspond 

to  the  same  distance  variable).  Equation  (11)  can  be  compactly  written  as 

dpit)  =  J]  <S>i,jiGiit))pit)dNiit)+  Yj  ^ i,ji0jit))Pit)dNjit ). 


(12) 
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where  the  nxn  dimensional  matrices  O,j(0;(f))  and  T',j(0/(t))  are  defined  as: 


and 


-(1-dO 
®i,j(0i(t))  =  (1  ~  Ai)X{0i(i)=l) 

0 


at  entry  [(/, ./)(/, ./)] 
at  entries  [(i,j)(lj)\, 
all  other  entries  , 


/  €  Nu  I  4  j,l  4  i 


Vijidjit)) 


-d-Aj) 

(1  ~  A  j)X {6 j{t)=m} 

0 


at  entry  [(/,  /')(/,  /')] 

at  entries  [(i,f)(m,i)\,  m  e  Nj.m  4  j,m  4  i 
all  other  entries  . 


The  dynamics  of  the  first  moment  of  the  vector  rj(t)  is  given  by 


jE{ m=  X  E  (o,- /0,(O)>KO/L  +  A1  ij(6j(t))T](t)iUj^ . 

Using  the  independence  of  the  random  processes  6  ft),  we  can  further  write 

^■E{rm  =  WE{nm 
at 

where  W  is  a  h  x  h  dimensional  matrix  whose  entries  are  given  by 


'  -(1  -  A,)/j,  -  ( 1  -  Aj)Hj  l  =  i  and  m  =  j 
(1  -  Ai)niPi,i  l  e  Nu  m  =  j,  j, 

(1  -Aj)pjPj,m  1  =  i,  m  £  Nj,  m  ±  i, 

0  otherwise. 


(13) 

(14) 

(15) 

(16) 

(17) 


The  following  Lemma  studies  the  properties  of  matrix  W,  introduced  above. 

Lemma  4.1:  Let  W  be  the  nxn  dimensional  matrix  defined  in  (17).  Under  Assumption  3.1,  the  following 
properties  hold: 

(a)  Let  G  be  the  directed  graph  (without  self  loops)  corresponding  to  the  matrix  IT,  that  is,  a  link  from 

(/,m)  to  (/,  /)  exists  in  G  if  >  0.  Then  G  is  strongly  connected. 

(b)  The  row  sums  of  matrix  W  are  non-positive,  i.e., 

i,j)(l,m)  —  O5  4 (i,  j),  i  j. 

(c)  There  exits  at  least  one  row  ( i*,j *)  of  W  whose  sum  is  negative,  that  is, 

J]  <  0. 

Proof:  (a)  Consider  the  paths  from  agent  i  to  agent  /  (z  =  ao, . .  .,ak-\  -  l )  and  from  agent  j  to  agent 
m  (j  =  bo, . . .  ,bk-i  =  m).  By  Assumption  3.1  one  can  always  construct  same  length  paths  from  any  agent 
to  another  since  they  belong  to  the  same  equivalence  class.  We  use  (17)  and  dictate  and  algorithmic  proof 
which  ensures  the  existence  of  a  path  from  (z,  j)  to  (/,  m)  on  G: 


for  z  =  0  to  k  -  1 
If  az+ 1  4  bz 
jump  to  (az+\,bz) 
else  if  bz+\  4  az 
jump  to  (az,bz+\) 
else 

jump  to  (az+ubz+l) 
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Note  that  the  last  case,  the  condition  essentially  means  that  the  walker  does  not  move.  (We  consider 
the  nodes  (/,/)  and  (/,  i)  as  identical).  For  arbitrary  (/,_/)  and  (, l,m )  the  result  follows. 

(b)  Consider  a  row  (/,/).  For  convenience,  let  us  define  the  following  positive  scalars 

6  =  (1  and  £  =  (1  (18) 

We  can  express  the  sum  of  row  (/,/)’ s  entries  as 

^  [W]  (;,;)(/,  m)  =  ~(&  +  £/)  +  0  ^  Pi.l+Pj  ^  Pjjn  < 

(/,ra)  leNi,l^  j,m= j  meN j,mti,l=i 

<-(£+&) +6 +6  =  0. 

(c)  Consider  an  arbitrary  row  (z,/).  The  row  (/,  /)  would  sum  up  to  zero  in  two  cases.  In  the  first  case, 
i  Nj  and  j  4  Nu  which  imply 

^  pu=  land  ^  Pj.m  =  1 , 

IeNi.IJ:  j,m= j  meNj,mi^i,l=i 

and  therefore 

(l,m) 

However,  having  i  £  Nj  and  j  £  N\  for  all  i  and  j  would  imply  the  communication  graph  G  =  (V,E)  to 
be  disconnected,  contradicting  Assumption  3.1.  In  the  second  case,  i  £  Nj  and  j  £  Nj  and  | Af, |  =  1  and 
\Nj\  =  1  (that  is,  node  i  has  only  one  neighbor,  namely  j  and  j  has  only  one  neighbor,  namely  z).  In  this 
case 

J]  PU  =  Pij=  land  Yj  Pj,m  —  P  j,i  =  1 1 

j,m= j  m€Nj,m^i,l=i 

and  consequently 

(l,m) 

But  this  case  would  imply  that  the  nodes  z  and  j  are  separated  from  all  other  nodes  in  the  graph  G  =  (V,E), 
which  would  contradict  the  connectivity  Assumption  3.1.  Therefore,  there  must  exist  at  least  one  row  ( i*,j *) 
such  that 

X  [W](i*j*)(ym)  <  0. 

(l,m ) 


Consider  now  the  matrix  Q  =  /  +  eW,  where  I  is  the  identity  matrix  and  6  is  a  positive  scalar  satisfying 
the  strict  inequality 

0<6< - - - -  (19) 

max,. /f,  ur7) 

where  and  ijj  were  defined  in  (18). 

The  following  Corollary  follows  from  the  previous  Lemma  and  describes  the  properties  of  matrix  Q. 
Corollary  4.1:  Matrix  Q  has  the  following  properties: 

(a)  The  directed  graph  (without  self  loops)  corresponding  to  matrix  Q  (that  is,  a  link  from  ( l,m )  to  (i,j) 
exists  if  [Q\(ij),(/,m)  >  0)  is  strongly  connected. 

(b)  Q  is  a  non-negative  matrix  with  positive  diagonal  elements. 

(c)  The  rows  of  Q  sum  up  to  a  positive  value  not  larger  than  one,  that  is, 


\Q\(i,j)(l,m)  ^  4(1,  j). 

(l,m),lfrn 


(d)  There  exits  at  least  one  row  ( i*,j *)  of  Q  which  sums  up  to  a  positive  value  strictly  smaller  than  one, 
that  is, 

X  [0]((*,/)(/,»n)  <  I- 


Proof:  Noting  that  the  directed  graph  (without  self  loops)  corresponding  to  matrix  Q  is  identical  to 
the  one  corresponding  to  matrix  W,  part  (a)  follows.  The  diagonal  elements  of  Q  are  given  by 


iQ\(ij)(i,j)  =  1  ~e(fi  +  fj). 

Using  the  fact  that  0  <  e(fi+fj)  <  1,  and  the  obvious  observation  that  the  non-diagonal  elements  are 
non-negative,  we  obtain  part  (b).  The  sum  of  row  (/,  j)  entries  is  given  by 

1  «£[*!< 

( l,m )  (Z,m) 

and  using  parts  (b)  and  (c)  of  Lemma  4.1,  part  (c)  and  (d)  of  the  current  Corollary  follow,  respectively. 


Remark  4.2:  The  above  Corollary  says  that  the  matrix  Q  is  an  irreducible ,  substochastic  matrix.  In 
addition,  choosing  y  >  max,j  ^  1  -  ,  it  follows  that  we  can  find  a  non-negative,  irreducible  matrix  Q 

such  that  yQ  =  I +  Q.  Using  a  result  on  converting  non-negativity  and  irreducibility  to  positivity  ([12], 
page  672),  we  get  that  (I  +  Q)"^i  =  yn~lQn~l  >  0,  and  therefore  Q  is  a  primitive  matrix.  The  existence  of 
y  is  guaranteed  by  the  fact  that  Q  has  positive  diagonal  entries. 

We  have  the  following  result  on  the  spectral  radius  of  Q,  denoted  by  p(Q). 

Lemma  4.2:  The  spectral  radius  of  matrix  Q  is  smaller  than  one,  that  is, 


P(Q)<  l. 

Proof:  Let  (i,  j)  denote  an  entry  of  matrix  Q.  As  mentioned  in  Remark  4.2,  Q  is  a  primitive  matrix, 
and  therefore  there  exits  a  k  (which  in  our  case  is  h  -  1 ),  such  that  Qk  has  all  entries  positive,  that  is 

[Q\]>  0,  41,  j. 

In  addition,  since  Q  is  a  substochastic  matrix  we  have  that 

h 

1  v;- 

By  part  (d)  of  Lemma  4.2,  we  have  that  there  exits  a  j*  such  that 

h 

L  '-'1'  -  - ! 


/?=! 


Let  us  not  consider  the  matrix  Qk+l  =  QkQ.  The  sum  of  the  im  row  entries  of  matrix  QK+i  is  given  by 


th 


1/t+l 


Vv;- 1,.  V  v'iu  Vie ,, 

7=i  hhhf 


+  \Qk] 


i,r 


\h—  1  / 


Etci? 


V/7=l 


But  since 


0<J][Q]]:h<l,  Vj, 


h= l 


z  iq\] + 2Kaw 

7=i  7=  i  ,hf 


\h—t 


it  follows  that 


or 


1  s  E[e‘]u  - 1'-'  i  - 1  -  E[e1?. 

7=1  7=1  V  h=l 

Additionally,  since  0  <  Jfj=l[Qk]  1,]  ^  1.  \Qk\]*  >  0,  Tjjl=liQ\]*,h  <  1.  and  U-j=l[Qk+1\lj  ^  0.  it  must  be  that 

h 

YJYQk+%<\,  v7. 

7=i 

But  this  means  that  the  infinity  norm  of  Qk+l  is  smaller  than  one,  that  is 


nefc+1iico<i. 


or  that  p(Qk+ 1 )  <  1,  which  in  turns  implies  that 

P(fi)<l. 

By  the  Peron-Frobenius  Theorem  for  non-negative,  irreducible  matrices  ([12],  page  673)  p(Q)  corresponds 
to  the  positive  eigenvalue  of  Q,  larger  than  the  absolute  values  of  all  other  eigenvalues.  ■ 


V.  Proof  of  the  main  results 

In  this  section  we  prove  our  main  results  introduced  in  Section  III. 


A.  Proof  of  Theorem  3.1 

We  first  show  that  the  vector  77(f)  converges  to  zero  in  mean.  By  Lemma  4.2  we  have  that  the  spectral 
radius  of  Q  is  smaller  than  one,  that  is 

p(fi)  <  1. 

where  p(Q)  =  maxyl/ljgl,  with  Ajq,  i  =  being  the  eigenvalues  of  Q.  This  also  means  that 

Re(AlQ)<\,  V7.  (20) 

But  since  W  =  it  follows  that  the  real  part  of  the  eigenvalues  of  W  are  given  by 

Re(Alw)  =  ^(Re(AlQ)-  l)  <  0,  Vi, 

where  the  last  inequality  follows  from  (20).  Therefore,  the  dynamics 

=  WE{rj(t)} 
at 

is  asymptotically  stable,  and  hence  rj(t)  converges  in  mean  to  zero. 

We  now  show  that  //(/)  converges  in  rth  mean,  for  any  r  >  1.  We  showed  above  that  //,  7(/)  converges 
in  mean  to  zero,  for  any  i  4-  j.  But  this  also  implies  that  i]ij(t)  converges  to  zero  in  probability  (Theorem 
3,  page  310,  [5]),  and  therefore,  for  any  6  >  0 

lim  Prirnjit)  >  6)  =0.  (21) 

r— >oo  J 

Using  the  indicator  function,  the  quantity  rjjj(t)  can  be  expressed  as 

Vijit)  =  ni,j(t)X{rnj(t)<8}  +  rli,j(t)X{riij(t)>S }, 

for  any  6  >  0.  Using  (9)  of  Proposition  4.1  we  can  further  write 

rh.jU)  <  ^X{7lij(t)<8}+tnaxr)ij(0)x[riij(t)>s}, 

i,j 
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<  SrX\n,,m6\  +  (max^j(O) j  X[m,fi)>s), 

where  to  obtain  the  previous  inequality  we  used  the  fact  that  xtn,  j(t)<8\X{rii  ;(0><5!  =  0-  Using  the  expectation 
operator,  we  obtain 

E{r]ij(t)r}  <  <f  Pri <8)  +  |max?7ij(0)j  Pr{mj(t)  >  8). 

Taking  t  to  infinity  results  in 

lim  sup  E{Tjij(t)r}  <  8r,  Vfi  >  0, 


and  since  8  can  be  made  arbitrarily  small,  we  have  that 


lim  E{tjj j(t)' }  =  0,  Vr  >  1. 

/— »oo  J 

Using  (10)  of  Proposition  4.1,  the  result  follows. 


B.  Proof  of  Theorem  3.2 

In  the  following  we  show  that  //(/)  converge  to  zero  almost  surely.  Equations  (6)  and  (7)  show  that  with 
probability  one  is  non-negative  and  that  for  any  h<t\,  with  probability  one  rjijftf)  belongs  to  the 
convex  hull  generated  by  {rji^m(t i)  |  for  all  pairs  ( l,m )}.  But  this  also  implies  that  with  probability  one 

ma xrjijitf)  <  max rjij(t\).  (22) 

hi  hi 

Hence  for  any  sample  path  of  the  random  process  T](t),  the  sequence  {maxjjrjjj(t)}t>o  is  monotone 
decreasing  and  lower  bounded.  Using  the  monotone  convergence  theorem,  we  have  that  for  any  sample 
path  oj.  there  exits  f/Uo)  such  that 

lim  maxrji  ft, o>)  =  Tj(a>), 

t-^oo  ij 

or  similarly 

Pr\  lim  max?7;  ft)  =  fj}  =  1. 

v-*00  Uj  ’  / 

In  the  following  we  show  that  t)  must  be  zero  with  probability  one.  We  achieve  this  by  showing  that 
there  exits  a  subsequence  of  {max;j7/,j(?)}f>o  that  converges  to  zero  with  probability  one. 

In  Theorem  3.1  we  proved  that  rft)  converges  to  zero  in  the  rth  mean.  Therefore,  for  any  pair  (;',  j)  and 
( l,m )  we  have  that  E{rjij(t)rji^m(t)}  converge  to  zero.  Moreover,  since 

E{rhj(t)rji^m(t)}  <  maxrji  j{Qi)E{Tjim{t)}, 

hj 

and  since  E{rji^m(t)}  converges  to  zero  exponentially,  we  have  that  E{rjjj(t)rji^n(t))  converges  to  zero 
exponentially  as  well. 

Let  {tk}k>o  be  a  time  sequence  such  that  4.  =  kh,  for  some  h  >  0.  From  above,  it  follows  that  £,{||t7(^)||2} 
converges  to  zero  geometrically.  But  this  is  enough  to  show  that  the  sequence  {j](tt)}k>o  converges  to  zero, 
with  probability  one  by  using  the  Borel-Cantelli  lemma  (Theorem  10,  page  320,  [5]).  Therefore,  fj  must 
be  zero.  Using  (9)  of  Proposition  4.1,  the  result  follows. 
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C.  Proof  of  Corollary  3. 1 

The  main  idea  of  the  proof  consists  of  showing  that  the  convex  hull  of  the  states  of  the  agents  converge 
to  one  point,  for  any  sample  path  of  the  states  processes.  Let  to  be  a  sample  path  of  the  state  process  and 
let  {tk}k> o  be  the  time  instants  at  which  the  Poisson  counters  increase  their  values,  corresponding  to  this 
sample  path.  Additionally,  let  Ak  be  the  set  of  the  agents’  states  at  time  Ik,  that  is  Ak  =  ixj(tk),j  =  1  . .  .zzj. 
According  to  Definition  2.5,  Proposition  2.1  and  equation  (1)  of  the  randomized  gossip  algorithm,  we 
have  that 

Xi(tk+  \  )  e  co(Ak),  Vz. 

But  this  also  implies  the  next  convex  hull’s  inclusion 

co(Ak+x)Qco(Ak). 

From  the  theory  of  limit  of  sequence  of  sets  it  follows  that  there  exits  a  set  A0 0  such  that 

limsupco(Ayt)  =  liminf  co(A^)  =  \imco(Ak)  =A0o, 

where  Aoo  =  (~)k>0co(Ak ). 

Denoting  the  diameter  of  the  set  Ak  by 

diam(Ak)  =  sup{J(x,y)  |  x,y  &Ak), 

from  Proposition  2  of  [23],  we  have  that 

diam  (Ak)  =  d lain  ( co  (Ak)) . 


Additionally,  in  Theorem  3.2  we  showed  that 

\imd(xj(t),Xj(t))  =  0,  V  (/,./), 

t-AOO  J 

with  probability  one  and  therefore,  the  same  is  true  for  the  sample  path  to,  that  is 


lim  d(xj(tk),Xj(tk))  =  0,  V  (/,./). 

oo 


But  this  means  that 


lim  diam(Ak)  =  lim  diam(co(Ak))  =  0, 

k — >oo  k—>oo 


and  therefore  diam(Aoo)  =  0.  But  since  the  convex  metric  space  on  which  the  randomized  gossip  algorithm 
operates  satisfies  Property  (C),  and  the  sets  Ak  are  bounded  and  closed,  it  follows  that  the  set  Am  is  non¬ 
empty.  Consequently,  there  exits  a  point  x*,  which  may  depend  on  to,  such  that  ATO  =  x*,  and  the  result 
follows. 


VI.  The  rate  of  convergence  of  the  generalized  gossip  consensus  algorithm  under  complete  and  uniform 

CONNECTIVITY 

We  note  that  under  our  general  problem  setup  it  is  difficult  to  get  explicit  formulas  for  the  rate  of 
convergence  to  consensus,  in  the  first  and  second  moments.  We  are  able  however  to  obtain  explicit  results 
for  the  aforementioned  rates  of  convergence  under  specific  assumptions  on  the  topology  of  the  graph,  on 
the  parameters  of  the  Poisson  counters  and  on  the  convex  structure. 

Assumption  6.1:  The  Poisson  counters  have  the  same  rate,  that  is  pi  =  p  for  all  i.  Additionally,  the 
parameters  used  by  the  agents  in  the  convex  structure  are  equal,  that  is  A,  =  A,  for  all  i.  In  the  update 
mode,  each  agent  i  picks  one  of  the  rest  n  -  1  agents  uniformly,  that  is  Af,  =  N-  {z}  and  pLJ  =  ^-j.  for  all 
j  6  A fp 

The  following  two  Propositions  give  upper  bounds  on  the  rate  of  convergence  for  the  first  and  second 
moments  of  the  distance  between  agents,  under  Assumption  6.1. 


12 


Proposition  6.1:  Under  Assumptions  3.1,  3.2  and  6.1,  the  first  moment  of  the  distances  between  agents’ 
states,  using  the  generalized  gossip  algorithm  converges  exponentially  to  zero,  that  is 

E{d(xi(t),Xj(t))}  <c\eaxt ,  for  all  pairs  (/,  /),  (23) 

where  a i  =  - 1  and  c\  is  a  positive  scalar  depending  of  the  initial  conditions. 

Proof:  By  Proposition  4.1,  with  probability  one  we  have  that  for  any  pair  (/,  j)  d(xi(t),Xj(t ))  <  r/i,j(t) 
and  therefore  E{d(xi(t),Xj(t))}  <  E{rjjj(t)}.  But  the  convergence  of  E{rjij(t)}  is  determined  by  equation 
(16)  and  in  particular  by  the  eigenvalues  of  matrix  W,  which  are  studied  in  what  follows.  From  (17)  it 
immediately  follows  that  W  is  a  symmetric  matrix  and  that  every  diagonal  element  is  -2(1  -  A)p.  Note 
the  enumeration  of  the  vertex  set  of  graph  Q  as  (/,/)  with  (i  <  j).  Consider  an  arbitrary  node  (i,  j)  and 
write  the  element  of  the  corresponding  row  in  the  following  convenient  form 

(1.2) ,  (1,3),  ...,  (1  ,n) 

(2.3) ,  (2,4),  ...,  (2 ,n) 


(z  — 1,0,  O'- 

■1,1  +  1),  •••,  O'- 1,«) 

00+1),  ... 

,  (i,n) 

O'-iJ),  •• 

O'- On) 

O'G'+l),  ••• 

,  o» 

0  +  1.7  +  2),  ...,  (n-l,n) 


where  we  split  it  with  horizontal  lines  in  5  segments  (numbered  1  through  5  from  top  to  bottom).  Following 
(17)  observe  that  excluding  the  diagonal,  the  matrix  has  exactly  2i  -2  positive  elements  in  segment  1, 
n  —  i  —  l  positive  elements  in  segment  2,  j-i-  1  positive  elements  in  segment  3,  n-j  positive  elements 
in  segment  4  and  0  positive  elements  in  segment  5.  Therefore  the  total  number  of  off-diagonal  entries  in 
a  row  is  2n-4.  Again,  (17)  dictates  that  the  value  in  any  positive  element  is  pjP f.  As  a  consequence, 
we  conclude  that  the  sum  of  every  row  is  a\  =  -  ,  that  is  obviously  the  eigenvalue  of  the  right 

eigenvector  t„,  that  is  the  vector  of  all  ones.  Noting  that  W  is  symmetric  all  eigenvalues  are  real  and 
by  Greshgorin’  theorem  (Theorem  7.2.1,  page  320,  [4])  they  must  lie  in  the  circle  (-2(1  -  X)p,r)  where 
r  =  2(1  -  A)p'j^ y  is  the  sum  of  the  non  zero,  off-diagonal  elements  of  the  rows.  Note  that  the  eigenvalue 
a\  lies  exactly  on  the  boundary  of  the  circle,  in  the  negative  half  plane.  This  leads  us  to  conclude  that 
this  is  indeed  the  maximum  one.  Therefore,  there  exits  a  positive  scalar  c \  which  depends  on  the  initial 
conditions  such  that 

E{r]ij(t)}  <  c\eait,  for  all  (/,./), 

from  where  the  result  follows.  ■ 

Proposition  6.2:  Under  Assumptions  3.1,  3.2  and  6.1,  the  second  moment  of  the  distances  between 
agents’  states,  using  the  generalized  gossip  algorithm  converges  exponentially  to  zero,  that  is 

E{d(xi(t),Xj(t))2}  <  c2e<n‘,  for  all  pair  (/,./), 

2(\- A2) 

where  a2  =  -p  \  and  c2  is  a  positive  scalar  depending  of  the  initial  distances  between  agents. 

Proof:  As  before,  by  Proposition  4.1,  with  probability  one  we  have  that  for  any  pair  (i,  j)  d{xl(t),xl(t))  < 
p ij(t)  and  therefore  E{d(xft),Xj(t))2}  <  E{r;LJ(t)2}.  But  E{rjLJ(t)2}  <  £{||//(/)||2},  for  any  pair  (i,j)  and 
therefore  is  sufficient  to  study  the  convergence  properties  of  the  right-hand  side  of  the  previous  inequality. 
Using  Ito’s  rule  we  can  differentiate  the  quantity  ||»7(OII2  and  obtain 

Jt\\m\2  =  Yj  w  [°g(^(0) + t](t)dN i(t)+ 

id 
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+ £  nit)'  [VijiOjit)) + Vijidjit))' + t i,j(ej(t)y'i’i<j(0j(t))]  T](i)dNj(i), 
ij 

from  where  we  get 

jE{ \\m\2)  =  J]  E{1](ty  [°i./0i(O) + 

ij 

+ 2  E{Tj(ty  [VijiOjit)) + '¥ij(ej(t)y + ' VijWjwyvijVjit ))] 

ij 

Using  the  independence  of  the  random  process  9i(t )  and  Assumption  6.1,  we  can  further  write 

jE{\\m\2}=dJ]Em'HJim 

ij 


where 

h  =  + <s>iJmt)y®i,jMt))+ 

+x¥iJ(6j(t))  +  H'jJdjO))'  +  H'jjidjO))'^  j'jWj(t))). 


Using  Assumption  6.1,  we  have 


®ijmt))+®i,jmt)y  =  (!-*) 


-2 

X[0i(t)=i} 

0 


at  entry  (l,j)(Lj) 

at  entries  (; i,j)(l,j )  and  (/, ./)(«, ./)  Z  6  TV,,/  A  j 
at  all  other  entries 


or 


1 


©^■(O),o;J(0/a))  =  (i-d)2- 


-A{0;(O=/} 

A|0,(O=/} 

0 


at  entry  (i,j)(i,j) 

at  entries  (i,j)(l,j)  and  (/, ./)(/, ./')  /  e  A/,-,/  #  j 
at  entries  (/, ./)(/,  y)  /  6  TV,,  /  *  j 
at  all  other  entries 


-2 


%J(0/O)  +  n/0/W)/  =  (1-^)' 


A{e/o=/l 

0 


at  entry  (l,j)(Lj) 

at  entries  (i,j)(ij)  and  (/,/)(/,  /)  l  e  Nj,l  ±  i 
at  all  other  entries 


1 


^#/0)/%j(W)  =  (1-2)2< 


-A{0/O=/) 

A{e/0=/) 

0 


at  entry  (z,./)(U) 

at  entries  ( i,j)(i,l )  and  ( i,l)(i,j )  l  e  TV/,  /  =£  z 
at  entries  (z, /)(/,/)  l  e  Nj,l  ±  i 
at  all  other  entries 


£{Oy(0i(f))  +  =  (1  -A){  ^ 

10 


at  entry  (i,Jj)(i,Jj) 

at  entries  and  (l,j)(i,j)  l  e  Af/,/  *  j 

at  all  other  entries 


f  1 


£{o,;(e/a))/o;j(ei(0)}  =  (i-^)- 


1 


/l— 1 


0 


at  entry  (i,j)(Lj) 

at  entries  (l,j)(l,j)  and  (J,j)(i,j)  l  e  N,J  ±  j 
at  entries  (/, ./)(/, ./)  1  e  TV,,  /  *  j 
at  all  other  entries 


^{^^(^(0)  +  ^(^-(0)'}  =  (l  -  A) 


-2 

l 

A7— 1 
0 


at  entry  (i,j)(Lj) 

at  entries  (z,  /)(/,  /)  and  (z,  /)(/,  /)  l  e  Nj,  l  =£  z 
at  all  other  entries 
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E{'¥ij(6j(t)y'Vlj(6im  =  (1  -Af< 


1 

1 

n—  1 

1 

n—  1 

0 


at  entry  (i,j)(i,j) 

at  entries  (/,/)(/,/)  and  (i, /)(/,/)  l  e  Nj,l  t  i 
at  entries  (/,  /)(/,  /)  /  e  A/),  l  ±  i 
at  all  other  entries. 


Summing  up  the  above  matrices  we  obtain  that  is  a  symmetric  matrix  that  has  as  diagonal  elements 
quantities  of  the  form 


-4(1  -4)  +  (1  -  A)2 


2n-4\ 
«  - 1  / 


and  the  off-diagonal,  non-zero  entries  are  given  by 

A(l-A)^—/u. 

ft  - 1 

Counting  the  off-diagonal  entries  on  a  row  we  obtaine  the  same  result  as  in  the  case  of  the  first  moment. 
Namely,  the  number  of  non-zero  and  off-diagonal  elements  on  each  row  is  2(n  -  2).  Also  note  that  the 
diagonal  elements  are  negative  and  that  the  off-diagonal  and  non-zero  elements  are  positive  for  any  n  >2. 
Therefore  each  row  of  H  sums  up  to  the  same  value  and  consequently  H  has  an  eigenvalue 


Q"2 


-4(1  -  d)  +  (1  -  A)  2  + 


2ft  -4 

ft  - 1 


„„„  „  2  2(1  -A2)ju 

/y  +  2  (ft  -  2)4(1  -4) - -  n  =  -■ 


ft  - 1 


ft  - 1 


corresponding  to  eigenvector  A„.  Note  that  aj  is  negative  for  0  <  4  <  1  and  n  >  2.  In  addition,  by  Gershgorin’ 
theorem  (Theorem  7.2.1,  page  320,  [4]),  we  have  that  all  eigenvalues  belong  to  the  circle  centered  at 
[-4(1  -  4)  +  (1  -  A)2  (2  +  with  radius  2(ft  -2)4(1  -4)^-//  and  therefore  the  eigenvalue  cr2  dominates 

the  rest  of  the  eigenvalues;  eigenvalues  that  are  real  due  to  symmetry.  Therefore,  we  have  that 


H  < 


and  consequently 

^{||»7(0II2}<^{||^(0II2}. 

at 

We  can  further  write  that 

E{\\m\2}<ea2tEmm2}, 

from  where  the  result  follows.  ■ 

Remark  6.1:  As  expected,  the  eigenvalues  a\  and  02  approach  zero  as  n  approaches  infinity,  and 
therefore  the  rate  of  converges  decreases.  Interestingly,  in  both  the  first  and  the  second  moment  analysis, 
we  observe  that  the  minimum  values  of  a\  and  ao  are  attained  for  4  =  0,  that  is  when  an  awaken  agent 
never  picks  its  own  value,  but  the  value  of  a  neighbor. 

VII.  The  generalized  gossip  consensus  algorithm  for  particular  convex  metric  spaces 

In  this  section  we  present  several  instances  of  the  gossip  algorithm  for  particular  examples  of  convex 
metric  spaces.  We  consider  three  cases  for  X\  the  set  of  real  numbers,  the  set  of  compact  intervals  and 
the  set  of  discrete  random  variables.  We  endow  each  of  these  sets  with  a  metric  d  and  convex  structure 
ip  in  order  to  form  convex  metric  spaces.  We  show  the  particular  form  the  generalized  gossip  algorithm 
takes  for  these  convex  metric  spaces,  and  give  some  numerical  simulations  of  these  algorithms. 
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A.  The  set  of  real  numbers 

Let  X  =  R  and  consider  as  metric  the  standard  Euclidean  norm,  that  is  d{x,y)  -  ||v-y||2,  for  any  x,y  e  R. 
A  natural  convex  structure  on  R  is  given  by 

f(x,y,A)  =  Ax  +  (l-A)y,  Tx,y  e  R,A  e  [0, 1],  (24) 

Indeed  since  for  a  point  z  e  R 

d(z,f(x,y,A ))  =  ||z-(Tx  +  (l-T)y)||2  =  ||d(z-x)  +  (1  -A)(z-y)\h  < 

<  d||z-x||2  +  (l  -d)||z-y||2  =  Ad(z,x)  +  (l-A)d(z,y), 

f  is  a  convex  structure.  Therefore  (R,  ||  •  ||2,i/0  is  a  convex  metric  space.  For  this  particular  convex  metric 
space,  the  generalized  randomized  consensus  algorithm  takes  the  following  form 


Algorithm  1:  Randomized  gossip  algorithm  on  R 
Input:  xi( 0),  Au  Pij 
for  each  counting  instant  tl  of  Nj  do 

Agent  i  enters  update  mode  and  picks  a  neighbor  j  with  probability  p,  j  ; 
Agent  i  updates  its  state  according  to 

=  Aixfti)  +  (1  -  Ai)xj(ti); 

Agent  i  enters  sleep  mode; 


Note  that  this  algorithm  is  exactly  the  randomized  gossip  algorithm  for  solving  the  consensus  problem, 
which  was  studied  in  [2]. 

B.  The  set  of  compact  interx’als 

Let  X  be  the  family  of  closed  intervals,  that  is  X  =  {[a,b]  \  -  oo  <a<b<  oo}.  For  x\  -  [a(-,^],  Xj  =  [ aj,bj ] 
and  A  e  [0,1],  we  define  a  mapping  \|/  by  \\i(xi,Xj,A)  =  [da,  +  (  1  -  A)aj,Ab,-  +  (1  -A)bj]  and  use  as  metric 
the  Hausdorff  distance  given  by 

d(xj,Xj )  =  max{|<3;-  -  af,  \bj  -  bf}. 

Then,  as  shown  in  [24],  (X,d,\\i)  is  a  convex  metric  space.  For  this  convex  metric  space,  the  randomized 
gossip  consensus  algorithm  becomes, 


Algorithm  2:  Randomized  gossip  algorithm  on  a  set  of  compact  intervals 
Input:  xi( 0),  A,-,  ptj 
for  each  counting  instant  tt  of  Nj  do 

Agent  i  enters  update  mode  and  picks  a  neighbor  j  with  probability  puj  ; 
Agent  i  updates  its  state  according  to 

xftj  )  =  [Ajai(ti)  +  (1  —  Apa j(tf),  Ajbi(t[)  +  (1  —  Ai)b y ( r / ) ] ; 

Agent  i  enters  sleep  mode; 
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C.  The  set  of  discrete  random  variables 

In  this  section  we  apply  our  algorithm  on  a  particular  convex  metric  space  that  allows  us  the  obtain  a 
probabilistic  algorithm  for  reaching  consensus  on  discrete  sets. 

Let  S  =  {si,s2,...,sm}  be  a  finite  and  countable  set  of  real  numbers  and  let  (Q.,F,P)  be  a  probability 
space.  We  denote  by  X  the  space  of  discrete  measurable  functions  (random  variable)  on  (Q,  F,  V)  with 
values  in  S . 

We  introduce  the  operator  d  :  X  x  X  — ■>  R,  defined  as 

d(X,Y)  =  Er[p(X,Y)l  (25) 


where  p  :  RxR  — »  {0, 1}  is  the  discrete  metric,  i.e. 


p(*,y) 


1  x4y 
0  x  =  y 


and  the  expectation  is  taken  with  respect  to  the  measure  V.  It  is  not  difficult  to  note  that  the  operator  d 
can  also  be  written  as  d(X,  Y )  =  E\^l{x±y\  \  =  Pr(X  4  Y ),  where  t[x*Y}  is  the  indicator  function  of  the  event 
{X  4  Y}. 

We  note  that  for  all  X,Y,Z  e  X,  the  operator  d  satisfies  the  following  properties 

(a)  d(X,  Y)  =  0  if  and  only  if  X  =  Y  with  probability  one, 

(b)  d(X,Z)  +  d(Y,Z)  >  d(X,Y)  with  probability  one, 

(c)  d(X,Y)  =  d(YX), 

(d)  d(X,Y)>  0, 

and  therefore  is  a  metric  on  X.  The  set  X  together  with  the  operator  d  define  the  metric  space  (X,d). 

Let  7  6  {1,2}  be  an  independent  random  variable  defined  on  the  probability  space  (il.F.P),  with 
probability  mass  function  Pr(y  =  1)  =  A  and  Pr(y  =  2)  =  1  -  A,  where  A  e  [0, 1].  We  define  the  mapping 
\\r :  X  x  X  x  [0, 1]  — >  X  given  by 


Y(Xi,X2,A)  =  +  1{7=2}X2,  VXi,X2  6  X,A  £  [0, 1], 


(26) 


Proposition  7.1:  The  mapping  \|/  is  a  convex  structure  on  X. 

Proof:  For  any  U,X\,Xi  6  X  and  A  e  [0, 1]  we  have 

d(UMXi,X2,A))  =  E[p(UMXi,X2,A))\  =  E[E[p(UMXi,X2,A))\U,XuX2]]  = 

=  E[E[p(U,t{y=1]Xl+t{y=2]X2)]\U,Xl,X2]=E[Ap(U,X1)  +  (l  - A)p(U,X2 )]  = 

=  Ad(U,X1)  +  (l-A)d(U,X2). 


From  the  above  proposition  it  follows  that  (X,d,\y)  is  a  convex  metric  space.  For  this  particular  convex 
metric  space  the  randomized  consensus  algorithm  is  summarized  in  what  follows. 

Let  us  now  take  a  closer  look  to  the  probabilistic  model  of  the  above  algorithm.  Let  6  ft)  be  independent 
random  variables  with  probability  distribution  Pr(0f  t)  =  j)  =  pl  }  for  j  €  NL  and  for  all  t,  with  Z  /eyv,  PiJ  -  1- 
In  addition,  let  yft)  be  a  set  of  independent  random  variable  such  that  Pr(yff)  =  1)  =  T,  and  Pr(yft)  = 
2)  =  1  -  Ap  for  all  t.  Then  according  to  the  generalized  gossip  algorithm,  at  each  time  instant  ti  at  which 
the  counter  Nft)  updates  its  value,  agent  i  updates  its  value  according  to  the  formula 

=  X{yiiti)=\}Xiiti)  +X[yi{ti)= 2}  J] XMti)=j}xj(ti)-  (27) 

jeNi 

Let  (Q,  P,  T)  be  a  probability  space,  with  Tt  a  filtration  of  T  given  by 

Ft  =  cr(xi(s),Ni(s),yi(s),6i(s),0  <  s  <  t,i  =  1, . . .  ,n). 
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Algorithm  3:  Randomized  gossip  algorithm  on  countable,  finite  sets 


Input:  Xi( 0),  A/,  ptj 

for  each  counting  instant  tj  of  Nj  do 

Agent  i  enters  update  mode  and  picks  a  neighbor  j  with  probability  pl  f  ; 
Agent  i  updates  its  state  according  to 


xftf)  = 


x fti)  with  probability  Aj 

Xjiti)  with  probability  1  -  At 


Agent  i  enters  sleep  mode; 


where  we  used  cr  as  a  symbol  for  sigma  algebra.  By  (27),  it  follows  xft)  is  adapted  to  the  filtration  Tt. 
Let  us  now  consider  the  filtration  TtN  =  cr(Nj(s),0  <  s  <  t,i  =  l,...,n),  induced  by  the  Poisson  counters 
Nft).  In  order  to  accommodate  the  contribution  of  the  Poisson  counters  to  the  probability  model  of  the 
algorithm,  we  must  refine  the  metric  proposed  in  (25).  As  a  consequence,  at  each  time  instant,  the  distance 
between  agents  is  given  by 

d(xft),Xj(t ))  =  Ep[p(xi(t),Xj(t))\TtN], 

where  the  expectation  is  taken  with  respect  to  the  measure  P.  Consequently,  d(xj(t),Xj(t ))  is  measurable 
with  respect  to  the  sigma- algebra  7y'v. 

D.  Numerical  simulations 

In  this  subsection  we  present  numerical  simulations  of  the  generalized  gossip  algorithm  in  the  case  of  the 
three  convex  metric  spaces  previously  mentioned.  We  consider  a  network  of  n  =  20  nodes,  each  of  which 
is  equipped  with  a  Poisson  counter  with  rate  p  derived  uniformly  and  independently  from  the  interval 
(0,6].  The  Poisson  counters  are  independent  among  agents.  Furthermore  each  agent  will  be  equipped  with 
a  convex  parameter  A  which  is  chosen  uniformly  and  independently  from  [0, 1).  At  every  ignition  time 
each  agent  will  connect  with  any  other  agent  with  probability  p  -  ^-y.  For  each  the  three  convex  metric 
spaces  we  present  two  figures:  the  first  figures  show  the  values  of  the  states,  while  the  second  figure 
depicts  upper  bound  on  of  the  distances  between  the  agents’  states,  that  is  the  quantities  r]ij(t).  Our  focus 
is  on  showing  that  the  vector  of  distances  converge  to  zero  and  that  the  states  converge  to  the  same  value 
and  therefore  to  simplify  the  figures’  depiction,  all  quantities  are  represented  using  the  black  color. 

Figure  1  shows  a  realization  of  the  generalized  consensus  algorithm  in  the  case  of  the  convex  metric 
space  defined  on  the  set  of  real  numbers.  We  assume  that  the  agents  initialize  their  values  uniformly  from 
the  interval  [-2,2].  As  expected  the  distances  between  the  states  of  the  agents  converge  to  zero  and  the 
states  converge  to  the  same  value. 

Figure  2  shows  a  realization  of  the  generalized  gossip  algorithm  in  the  case  the  convex  metric  space  is 
defined  on  the  set  of  closed  intervals.  We  present  a  sample  path  of  the  actual  values  of  the  states  (which 
are  intervals  of  the  form  [a(-,  £>,-])  together  with  the  corresponding  bounds  on  the  distances  between  the 
states.  We  consider  the  initial  intervals  to  be  initialized  in  [-2,2]. 

Figure  3  shows  a  realization  of  the  generalized  gossip  algorithm  in  the  case  the  set  X  is  given  by  the 
set  of  discrete  random  variables.  As  in  the  case  of  the  set  of  real  numbers,  the  agents  initialize  their  values 
uniformly  from  the  interval  [-2,2],  however  their  values  will  belong  to  the  set  [xi(0),X2(0),...,x;;(0)}  for 
all  time  instants.  As  a  consequences,  both  the  states  and  the  distances  oscillate  more,  but  nonetheless  the 
distances  converge  to  zero  and  the  states  converge  to  a  common  value. 

VIII.  Conclusions 

In  this  paper  we  analyzed  the  convergence  properties  of  a  generalized  randomized  gossip  algorithm 
acting  on  convex  metric  spaces.  We  gave  convergence  results  in  almost  sure  and  rth  mean  sense  for  the 
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Gossip  Algorithm  on  R  -  Variables 


(a) 


(b) 


Fig.  1:  Randomized  Gossip  Algorithm  on 
distances  between  the  states  of  the  agents. 


L  (a)  the  values  of  the  states;  (b)  (upper  bounds  on  the) 


Gossip  Algorithm  on  Intervals 


(a) 


(b) 


Fig.  2:  Randomized  Gossip  Algorithm  on  Closed  Intervals:  (a)  the  values  of  the  states  (the  vertical  axis 
depicts  both  ends  of  the  intervals  [a((0,^/(0]  which  stand  for  the  agents’  states);  (b)  (upper  bounds  on 
the)  distances  between  the  states  of  the  agents. 


distances  between  the  states  of  the  agents.  Under  specific  assumptions  on  the  communication  topology, 
we  computed  explicitly  estimates  of  the  rate  of  convergence  for  the  first  and  second  moments  of  the 
distances  between  the  agents.  Additionally,  we  introduces  instances  of  the  generalized  gossip  algorithm 
for  three  particular  convex  metric  spaces  and  presented  numerical  simulations  of  the  algorithm. 
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